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@ Fish color grader. 

@ A hand held apparatus is disclosed to color grade fish 
fillett.The apparatus illuminates^a'sampierflilet^andnneasures: 
the intensity of the resultant reflected light at certain frequen- 
cies at which hemoglobin displays peculiar absorption char- 
acteristics. The apparatus ratios these measured intensittes 
and compares the ratios with stored sets of values represent- 
ing ratios of intensities of reflection at these frequencies 
which would be expected for flesh of various color grades. 
The apparatus displays the color grade associated with the 
closest set of values. 
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PISH COI/)R GRADER 0221 642 



This invention relates to an apparatus to. determine the color 
5 grade of a sample of a known substance, it has particular 
application to the grading of fish flesh. 

In the cominercial fishing industry, it is common to grade fish " 
fillets in order to determine their acceptability and price. Of 
10 key concern is the concentration of hemoglobin in the fillet 
since its presence could, result in mi- acoeterated deterioration 
of th« flesh. As hemoglobi-n is usually the dominant colorant in 
a fillet, color grading is employed to obtain an indication of 
the concentration of hemoglobin. Visual color grading is common 
15 and it is known to use standardized color chips to assist in such 
grading. However, the accuracy of visual comparisons between 
color chips and the fillet is limited by the phenomenon of 
metamerism. That is, two objects with different spectral 
reflectance curves may color match for some observers and not for 
20 others due to differences in color vision from person to person. 
Further, such two objects may color match for one observer under 
some lighting conditions and not under others. The accuracy of 
visual comparisons in the color grading of whitefish is also 
limited due to the necessity of discriminating between subtle 
25 differences in 20 shades of white. Thus, particularly for 

dockside fish fillet grading where lighting conditions can vary 
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considerably, an objective color instrument would eliminate color 
grade uncertainties. 

Briefly stated, the present invention is an apparatus to measure 
S the color grade of a sample of flesh of a known species 

comprising: a light source for illuminating the sample; means to 
detect the intensity of light reflected from the sample in 
response to illumination from the light source at a plurality of 
frequencies at which hemoglobin displays peculiar light 

10 absorption characteristics in order to obtain a set of 

intensities; means to compare the detected set of intensities 
with other sets of values, each other set of values representing 
the relative intensity of light at said frequencies corresponding 
to a known color grade of flesh of the species, in order to 

15 determine the color grade of the sample. 

In the figures which illustrate a preferred embodiment of the 
invention : 

20 Figure 1 is a graph showing the spectral absorption curve of 
hemoglobin; 

Figure 2 is a schematic diagreon of the components of the fish 
color grader of this invention; and 

25 ^ . ' 
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Figure 3 is a flow chart for the operation of the fish color 
grader of Figure 2. 

By reference to figure 1, it is seen that the components of 
5 hemoglobin have characteristics light absorption curves. The 
composite of these curves display significant local light 
absorption maxima centered at about the frequencies 425 
nanometers and in the range of 54 0-580 light at about 625 
nanometers. Consequently, where hemoglobin is the primary 

10 colorant in a particular species of flesh, it is possible to 
obtain a ratio of the intensity of reflected light at 625 
nanometers to reflected light at 540-58^ nanometers (or 425 
nanometers) from various samples of this flesh and these ratios 
would indicate the relative concentrations of hemoglobin in the 

15 samples. Both the ratios of light at 625 nro to light at 540-580 
nm and light at 625 nm to light at 425 nm may be utilized when 
increased sensitivity is desired. 



In the present invention, to utilize the foregoing, the color 
20 grades of a number of samples of flesh of a particular species 
may be carefully determined by conventional means in a controlled 
setting. The af oredescribed ratios, which are indicative of 
hemoglobin concentration , may then be determined for each sample 
so that a table may be drawn up listing range of ratios and the 
25 particular color grade associated therewith. Such a table is 
incorporated in the apparatus of this invention so that after 
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determining the af oredescribed ratio for a sample of flesh of the 
particular species, the color grade of the sample may be readily 
determined. 

5 Figure 2 depicts the apparatus of this invention for measuring 
the color grade of a fish fillet 2 of given species, say, for 
example, a flounder fillet. The apparatus includes a high 
Intensity pulsed light source 3 whose bandwidth covers the 
spectrxam from 400 nm to 700 nm. A sample window 4 permits light 

10 from the light source 3 to impinge upon fish fillet 2 and it also 
permits light reflected from the fillet to reach a 1500 i\ by 50 t\ 
sTit 5. The slit is positioned in front of and off the axis of a 
35 millimetre focal length lens 6 behind which is positioned a 
Littrow mount prism 7 with a mirrored back surface 8. A . 

15 photodiode array 9 is also positioned in front of and off the 
axis of lens 6 but on the side of the axis opposite to slit 5. 
The array 9 comprises 128 silicon photodiodes placed in 
side-by-side relation. The photodiodes of the array are 
selectively electrically coupled to amplifier 10 by scan 

20 controller 11. The output of the amplifier 10 is connected to an 
input of multiplex amplifier 12. Photodiode 13, which is in 
di^2rect" opt±cai- communication with light source 3, is connected to 
another input of multiplex amplifier 12. Multiplex amplifier 12 
is electrically coupled to high speed (less than 30 

25 microseconds) , high resolution (at least 12 bits) A/D converter 
is under control of scan controller 11. The A/D converter, an- 
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EPROM 16, a RAM 17, and a conventional LCD display 18 are 
connected between a data bus 19 and an address bus 20 • The A/D 
converter outputs digital data to the data bus addressed to the 
RAM 17 under control of scan controller 11. 

5 

Overall system control- is provided by microprocessor 21. More 
specifically, the microprocessor is connected to the data bus 19 
and address bus 20. It is also connected to scan controller 11 
and to a power up circuit 22, high voltage supply 23 and trigger 
10 circuit 24. 

The. miTrroprocessor^ and as well the scan controller and A/D 
converter, receive clock pulses from clock generator 25. The 
microprocessor receives an on/off indication from select switch 

The system is powered by a battery 27 which is connected to the 
power up circuit 22 and multiplex amplifier 12. The battery may 
be recharged through power supply 28. Power up circuit 22 is 
20 also connected to trigger switch 29 and high voltage supply 23. 
The high voltage supply is connected in parallel to a high, 
voltage capacitor 3D, trigger circuit 24, and the light source 3. 

In operation, light source 3 is pulsed under control of 
25 microprocessor 21 after trigger switch 29 is activated. If the 
operator has placed the sample window 4 of th^ apparatus on a 
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fish fillet- 2 prior to activating the trigger switch, then light 
from source 3 passing through the sample window will impinge upon 
fillet 2. As described hereinbefore, the amoimt of incident 
light which will be absorbed by a fillet at certain frequencies 
5 depends upon the concentration of hemoglobin in the fillet. 
Consequently, too, the light reflected from- the fillet at these 
frequencies depends upon the fillet's concentration of 
hemoglobin. The light reflected from the fillet which passes 
through slit 5 refracts into a non-linear spectrum of from 400 

10 nanometers (blue) at one end to 700 nanometers (red) at the 

other, as this is the wavelength range produced by light source 
"3. ~ Thh spectrum hits lens 6 Which directs it to prism 7 and the 
light entering prism 7 is reflected bac)c from the mirrored back 
surface 8 of the prism to lens 6 where it is directed to the 

15 photodiode array 9. The 128 linearly arranged diodes of the 

array 9 each pick up a small portion of the spectrum of reflected 
light, to wit, light covering about 6 nanometers dLn red end and 
about 1.5 nanometers in the blue end. The 50 i\ slit limits the 
resolution to about 12 nanometers in the red. and about 3 

20 nanometers in the blue end. 

Scan controller 11, cl^c}eed^±rrh±gh^^peed^by~c=lock- 25, 
couples the electrical output of selected diodes of the array 
through amplifier 10 to multiplex amplifier 12. The diodes 
25 selected are determined by microprocessor 21 which reads the 

li^ht frequencies of concern f rom EPROM 16. The EPROM has., been - 

pat012/12/7 



09:21:40 



7 



CW-1108 



0221642 

preprogrammed with information enabling the apparatus to color 
grade a specific species of meat, in this description, cod flesh. 
The EPROM, therefore, stores the information that the light 
frec[uencies of interest are 425 nanometers, 540-*580 nanometers, 
5 and 625 nanometers. 

The output of diode 13, which is in direct optical communication 
with light source 3,. is also input to multiplex amplifier 12 
after being integrated by integrator circuit 14. The multiplex 

10 amplifier multiplexes, in a time division manner, the signal 

generated by the diode 13 and the signals from all except one of 
diodes of array 9 coupled to the multiplex amplifier by scan 
controller 11. The multiplexed analog signals are accepted by 
A/D converter 15 under timing control of scan controller 11, and 

15 the resulting digital signals are stored in RAH 17. In this way, 
a set of multiplexed signals is stored in RAM 17, one signal for 
each diode in the array 9 and one signal for the output of diode 
13 at the time of sampling of the diodes in the array, 

20 Scan controller 11 sends an indication signal to the processor 
after it has prompted the A/D converter 15 to accept the last 
signal fxam^ul*xpl^ex^ampl^^Mx- 12 The^-processor then retrieves 
each data representation of the output from selected diodes of 
array 9 in turn and divides same by the stored representation of 

25 the output of diode 13 at the time of sampling. The set of 
ratioed output signals thus obtained represents the relative 
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intensity of reflected light from each sampled part of the 
spectrum irrespective of the intensity of light from source 3 
which illuminated the fillet 2 at the time of sampling. The 
processor stores the ratioed measured set in RAM 17. 

5 

The processor repeats this sequence four times then averages the 
four measured and ratioed sets. Next, the processor divides the 
average reading at 625 nanometers by the average reading at 425 
nanometers to obtain a ratio indicative of the color grade. The 

10 processor also determines the ratio between average intensity at 
625 nanometers and in the range of 540 to 580 nanometers. The 
processor then compares these two ratios with ratios stored in 
EPROM 16 in search of the stored ratios that most closely 
approximate the measured color grade ratios. The ratios stored 

15 in EPROM 15 represent the relative intensity of light at, 625 to 
425 nanometers and at 625 to 540-580 nanometers which would be 
expected for a cod fillet of various color grades. The EPROM 
stores an indication of the grade associated with each set of 
ratios. The frequencies at which the EPROM ratios are based are 

20 also stored in the EPROM for supply to the processor for its 
determination of which channels will be processed and which of 
those remaining will be discarded. After the processor findszHthe 
closest stored set of values, it instructs the display to show 
the grade associated with the stored set, for example, "A" for 

25 premium^ "B" for standard, "C" for a fillet which should be 
- rejected* , 
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The control sequence for the apparatus will now be described in 
detail with reference to both figures 1 and 2 of the drawings. 



The battery 27 is electrically connected to the apparatus through 
5 a switch (not shown) to power up the apparatus (box 100) , At 
this point the microprocessor 21 initialises the system (box 
101) . The initialization process includes self diagnostics on 
the power supply system memory, data bus, input/output port and 
timer and sets up the necessary counts and registers if a fault 

10 is detected then a red LED is activated and the system may or may 
not be shut down depending upon the seriousness of the fault. 
• Assuming no malfunction, then a yellow LED is turned on and 
control is passed to the user. Following initialization, the 
microprocessor will read the active species select data from a 

15 low power latch (box 135). The latch is kept active even during 
power down as long as the hand held unit is attached to the power 
supply. The default "first power-up** mode is "COD". The 
processor then signals the display 18 through address buss 20 to 
accept a data signal on bus 19 which results in the appearance of 

20 the selected species message "COD* (at first use) on the display 
box (102). The microprocessor then enables an interrupt and 
begins to decrement an internal counter in respDrfse??*tor^pui^es^ 
from the clock generator 25 (box 103a - 103f inclusive) . The 
microprocessor is programmed to power down the apparatus when 

25 this counter times out. The processor then checks whether thW 
sieiect switch is in the "on", position (box 104a) . This switch is 

pat012/12/10 



IQ CW-H08 

0221642 

activated by the operator when he wishes a previously measured 
color grade of the fish fillet displayed. If the switch is off ^ 
the processor then tests the battery to ensure it is operational 
(box 105a) , if not, the processor imroedistely powers down the 
5 apparatus (box 106a). So long as the battery is operational, the 
processor next checks whether the trigger switch 29 is in the 
"on" position (box 107) . This sv/itch is activated by the 
operator when he wishes the apparatus to take a color grade 
reading. If this switch is also off, then the control sequence 
10 will return to box 104a and will again test for activation of the 
sele^ct switch 26 . 

If, in reaching box 107 in the control sequence, the trigger 
switch is found to be "on", the processor stops all timers . (box 
15 109a) , instructs the- display to display the word "SAMPLING" (box 
110) and clears a flag called VALID thereby setting it to its 
logically false value (box 111) . The flag VALID will be reset to 
its logically true value later in the control sequence if the 
data seunpled by the processor appears to be valid. 

20 

The processor then sets a light flash counter to four (box 112) 
a:nd^ prompts- the^-ch^Txre circuit 22 to energize the high voltage 
supply 23 (box 113) . The high voltage supply then builds up the 
requisite charge on capacitor 30. The processor continuously 
25 checks that the high voltage supply has generated the requisite 
high voltage (box 114), if not, the processor instructs the 
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display to display "NO.. H.V.* (box 115) and then sets t9^ ?il^i^ 
time to 4 sees (box 108) and starts a display timer (boxes 116 
a-e) clocked by cloc)c generator 25 and returns to box 105a for a 
re-check of the battery. Note that if the operator has released 
5 the trigger switch by this time, the processor will instruct the 
display to display the selecteid species name "COD" after the 
display timer times out (boxes 109b, 131 and 102). 

Assiaming the proper high voltage has been generated, the 
10 processor sends a signal to the trigger circuit 24 to prompt it 
to fire the pulsed light source 3. As af oredescribed , this 
results in the storage in RAM 17 of a digital representation of 
the intensity of light, at selected frequencies, reflected from a 
sample covering window 4. it also results in the digital storage 
15 of the analog output of diode 13 which measures the intensity of 
light source 3 (box 117). At this point, the processor checks 
the digital signal representing the- level of output of diode 13 
against a preset minimum in order to determine whether light 
source 3 did indeed flash (box 118) . If not, it instructs the 
20 display to display "NO FLASH" (box 119), sets the display time to 
4 sees (box 108) and starts the display timer (boxes 116 a-e) and 
re-check-B the battery (box 105a) • The control sequence then 
proceeds from box 105a as described hereinbefore. 

25 Assuming the strobe did flash, the processor then divides the 
digital represenJ:ation of the output of selected diodes of array 
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9 by the output of diode 13 and stores the result in RAM 17, as 
aforedescribed (box 120) . 

Next the processor integrates the first eight data channels (box 
5 121) and if it is the first of the four samples (box 132) , it 
will store that value in both the minixnim and maximiun ihembry 
registers (box 133), On the subsequent three samples, the values 
of the min/max registers are compared with the present sample 
value. Depending upon whether the sample value is greater than 
10 the maximum or less than the minimum it will replace the value 
whose condition pr-evioudsly presented is true, if. aaiy (isox. 1 ^4-) . 



The processor then decrements the flash counter (box 122) and, if 
this counter has not decremented to zero, the processor a^gain 

15 prompts the charge circuit (box 113) , fires- the flash, aaid- stores 
the new measured set of values. After looping through this 
sequence four times, the flash counter reaches zero (box 123) and 
the processor then finds the difference between the maximum and 
minimum values previously obtained (box 124) . If the measured 

20 difference value falls outside of the limit of permissible range 
values stored in the EPROM, the processor interprets the data as 
faulty (box 125) , instructs the -drsplay to display "HBFEKT" (box 
126) , sets the display timer and then re-checks the select 
switch, battery, and trigger switch through boxes 104a, 105a, 107 

25 and a portion of the control sequence aforedescribed. 
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If the data falls within the present ranges, the processor 
averages the measured sets, obtains a ratio indicative of the 
color grade, corresponding with the selected species and searches 
for the closest ratio in EPROM 16, all as af oredescribed. 

5 

After the processor finds the closest stored set of values, it 
sets the VALID flag to true {box 128) and, instructs the display 
to show the grade associated with the stored set (box 130) . The 
processor then sets the display time to 20 seconds (box 131) and 

10 starts the display timer (box 116 a-e) and checks the select 
switch (box 104a) , the battery (box laSa) , and trigger switch 
(box 107) as previously discussed. If the trigger switch has 
been released, the determined grade will be displayed until the 
display timer times out, after which the species message ■COD" 

15 will again be displayed on the display (boxes 109b, 135, 102). 

The purpose of the select switch 26 is to redisplay a measured 
grade after it has ceased to be displayed in consequence of the 
display timer timing out. Thus, when the control sequence 

20 reaches box 104a, if the select switch is activated, but not held 
for longer than two seconds (box 132, and 133 a-e) then control 
passes to box 129, and, if the flag VALID has been set, the 
previously measured grade is displayed (box 130) and the display 
timer restarted (boxes 131 and 116 a-e). If the flag VALID is 

25 not set, which is the case prior to the first grade determination 
has been aborted due to faulty data, then activation of the 
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select switch merely results in the display of the current 
species name i.e.: "COD" (box 129). 

However r if the select switch 26 is held down for longer ther. 
5 momentary (i.e. greater than 2 seconds) (box 104b) then the 
microprocessor enters a loop where both the battery level and 
select switch status are checked until either a two second timer 
times out and updates the species latch with the next species 
(boxes 133 and 134) or the battery fails and the system powers 
10 down (boxes 105b and 106b) or the select switch is released 
causing the flow to resume with box 129. 

EPROM 16 may be re-programmed with data which allows the 
apparatus to color grade other species of fish. The apparatus of 
15 this invention, when set up for grading whitefish, is calibrated 
against a barium sulfate white reference surface and correction 
factors based on this reference color are determined 
automatically by the microprocessor for correction of each color 
channel during measurement. 

20 

The apparatus y as described, may be made so as to be watertight 
and hand held and may be fabricated with relatively i^expewsive^ 
components. The window 4 should be fabricated so as to be easily 
cleanable and scratch resistant. 
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While a preferred embodiment has been described, numerous 
variations are possible which fall within the spirit of this 
invention. For example, the monochromator may be replaced by a 
holographic grating or wedge filter; the light source could 
5 illuminate the fillet via a fibre optic bundle rather than 

directly, and the apparatus could be configured to function at a 
set stand-off from the fillet rather than by window 4 contacting 
the fillet 2. 

10 The device can be adapted to grade other types of meat. Similar 
processing strategies would be utilized to establish relative 
hemoglobin levels. Hpwever, the large concentration of heme 
proteins remaining in bled meats would require that these 
strategies examine additional frequencies in the nominal color 

15 spectrum from 400 to 700 nanometers in wavelength. 

This application has been specifically directed toward the color 
grading of whitefish, and it will become apparent to those 
skilled in the art that a similar device may be effectively 

20 utilized in the color grading of tuna and salmon. A further 

extension of the present device is in the grading of P.S.E. pork 
(pale, soft, exudative) wherein a light prolse^isi^insei^ted-into 
the pork undergoing test to sample the pork flesh coloration 
below the surface. The device may also be used to color grade 

25 lumber when calibrated for this purpose. 
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THE EMBODIMENTS OP THE INVENTION IH WHICH AH EXCLUSIVE 
PROPEKre OR PRIVIUBGB IS CIAIMED AKB DEFINED AS FOLLOWS s 



1. An apparatus to measure the color grade of a sample of flesh 
of a known species comprising: 

a. a light source for illuminating the sample; 

b. means to detect the intensity of light reflected from the 
sample in response to illumination from the light source 
at a plurality of frequencies at which hemoglobin 
displays pewliar light absorption characteristics in 
order to obtain a set of intensities; 

c. means to compare said detected set of intensities with 
other sets of values, each said other set of values 
representing the relative intensity of light at said 
frequencies corresponding to a known color grade of flesh 
of said species, in order to determine the color grade of 
said sample. 

2. The apparatus of claim 1 including means to adjust each said 
detected intensity in accordance with the intensity of said 
light source. 
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3. An apparatus to xneasure the color grade of a san-ple^ff^iLt^ 
of a knovm species comprising: 

a. a light source for illuminating the sample, 
5 b. means to detect the intensity of light reflected from the 
sample In response to illumination from the light source 
at at least one first frequency where light is minimally 
absorbed by hemoglobin and at least one second frequency 
where light is absorbed a significant peculiar amount by 
hemoglobin; 

c. means responsive to said at least one first frequency and 
said at least one second frequency to obtain at least one 
ratio; 

d. means to compare said ratio ^ith compatible ratios 
representing known color grades of flesh of said species 
in order to determine the color grade of the sample. 

4. The apparatus of claim 3 wherein said at least one first 
frequency is at least one of about 425 nanometers and a 
frequency In the range of about 540 to 580 nanometers and 
said at least one second frequency is about 625 nanometers. 

5. The apparatus of claim 4 wherein said flesh is whitefish 
flesh. 



15 
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